Skip to content

Conversation

@Fokko
Copy link
Collaborator

@Fokko Fokko commented Oct 9, 2025

What changes are proposed in this pull request?

Adds an accessor for Binary blobs

Resolves #1382

How was this change tested?

@codecov
Copy link

codecov bot commented Oct 9, 2025

Codecov Report

❌ Patch coverage is 94.04762% with 5 lines in your changes missing coverage. Please review.
✅ Project coverage is 84.68%. Comparing base (2ec1462) to head (570b648).

Files with missing lines Patch % Lines
kernel/src/engine/arrow_data.rs 90.69% 0 Missing and 4 partials ⚠️
kernel/src/engine_data.rs 97.22% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1383      +/-   ##
==========================================
+ Coverage   84.65%   84.68%   +0.02%     
==========================================
  Files         115      115              
  Lines       29557    29641      +84     
  Branches    29557    29641      +84     
==========================================
+ Hits        25021    25100      +79     
- Misses       3329     3330       +1     
- Partials     1207     1211       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link
Collaborator

@nicklan nicklan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. If we do this, we need to implement this for ArrowEngineData don't we?

Also, so far the visitors have been for extracting log data, and not any generic data. What's the use-case for this visitor?

@Fokko
Copy link
Collaborator Author

Fokko commented Oct 10, 2025

Thanks. If we do this, we need to implement this for ArrowEngineData don't we?

That's a good call. It does look like we need to use &[u8] instead of Bytes to avoid copies along the way. I think this also aligns better with the &str.

Comment on lines +788 to +789
let mut visitor = BinaryVisitor { values: vec![] };
arrow_data.visit_rows(&[ColumnName::new(["data"])], &mut visitor)?;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also do a test where we apply BinaryVisitor on something like ints or long?

Copy link
Collaborator

@OussamaSaoudi OussamaSaoudi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems reasonable 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add accessor for Binary in engine_data

3 participants